Toward Competency-Based Training: To What Extent Are We Competency-Based?

BACKGROUND: Time-based training models in plastic surgery vary in exposure, resulting in low confidence levels among graduates. The evolution of postgraduate medical education into a competency-based model to address these issues requires an understanding of interventions described in the plastic surgery literature to identify gaps and guide creation of assessments to demonstrate competence. METHODS: A systematic search of the MEDLINE, Embase, Cumulative Index to Nursing and Allied Health Literature, PubMed, and Cochrane databases from inception until December of 2017 was conducted using search terms and synonyms of educational interventions reported in plastic surgery. Full texts were retrieved following filtering and data extracted were related to intervention design and execution, involvement of competency assessment, and educational objectives and alignment to Accreditation Council for Graduate Medical Education competencies and Royal College of Physicians and Surgeons of Canada Canadian Medical Education Directives for Specialists roles. Study quality was assessed using Kirkpatrick's levels of learning evaluation, validity evidence, and the Medical Education Research Study Quality Instrument score. RESULTS: Of the initial 4307 results, only 36 interventions met the inclusion criteria. Almost all interventions aligned to medical knowledge and patient care Accreditation Council for Graduate Medical Education competencies. One-fifth of the interventions involved no assessment of competency, whereas most displayed assessment at the level of design as opposed to outcomes. Quality assessment revealed low levels of learning evaluation and evidence of validity; the average Medical Education Research Study Quality Instrument score was 10.9 of 18. CONCLUSION: A systematic review of educational literature in plastic surgery was conducted to assess the quality of reported educational interventions, and to help guide creating tools that ensure competency acquirement among trainees.

Harnessing the Potential Futures of CBME Here and Now.

The COVID-19 pandemic of 2020 exposed the reactive nature of the medical education community in response to a disruption that, at one time, may have seemed preposterous. In this article, the author reflected on the impact of an unpredictable plight on a system of medical education that (1) is continuous but doesn't function as a continuum and (2) requires adaptation but is steeped in a fixed mindset and structure that resists change. As a result, innovations which were previously considered impossible, such as time variable education and training, were forced into being. Inspired by the changes brought about by the pandemic, the ensuing decade is explored through a lens of possible futures to envision a path forward based on resilience rather than reactivity.

Undergraduate medical education amid COVID-19: a qualitative analysis of enablers and barriers to acquiring competencies in distant learning using focus groups.

Due to comprehensive social distancing measures related to the COVID-19 pandemic, medical faculties worldwide have made a virtue of necessity in resorting to online teaching. Medical faculties grapple with how to convey clinical competencies to students in this context. There is a need for research not only to map but also to explain the effect of these secondary measures on students' learning and mental wellbeing. During a period of ongoing comprehensive social distancing measures in Germany, we translated a competency-based curriculum including obstetrics, paediatrics, and human genetics to an e-learning course based on online patient and teacher encounters. In our qualitative study on students' and teachers' views, we identify potential enablers and drivers as well as barriers and challenges to undergraduate medical education under lockdown. In summer 2020, we conducted six focus group interviews to investigate medical students' and teachers' perspectives, experiences and attitudes. All focus groups were videotaped, transcribed verbatim and coded. To guide our deductive and inductive analysis, we applied the theoretical framework of Regmi and Jones. Content analysis was performed in a multi-perspective group. We identified five major themes contributing to a successful use of clinical competency-based e-learning under lockdown: Communication (with teachers, students, and patients), Mental wellbeing, Structure and self-organization, Technical issues, and Learning and commitment. We discuss enablers and potential barriers within all themes and their overlap and link them in an explanatory model. In our setting, students and teachers find e-learning holds strong potential and especially in times of COVID-19 it is greatly appreciated. We broaden the understanding of the impact of distant learning on acquiring competencies, on attitudes, and on mental wellbeing. Our model may serve for a thoughtful, necessary transition to future e-learning and hybrid programs for a competency-based medical education with ongoing social distancing measures.

Development of entrustable professional activities for paediatric intensive care fellows: A national modified Delphi study.

Entrustable professional activities (EPAs), as a focus of learner assessment, are supported by validity evidence. An EPA is a unit of professional practice requiring proficiency in multiple competencies simultaneously, that can be entrusted to a sufficiently competent learner. Taken collectively, a set of EPAs define and inform the curriculum of a specialty training. The goal of this study was to develop a set of EPAs for Dutch PICU fellows. A multistage methodology was employed incorporating sequential input from task force members, a medical education expert, PICU fellowship program directors, and PICU physicians and fellows via a modified three-round Delphi study. In the first modified Delphi round, experts rated indispensability and clarity of preliminary EPAs. In the subsequent rounds, aggregated scores for each EPA and group comments were provided. In round two, respondents rated indispensability and clarity of revised EPAs. Round three was used to gain explicit confirmation of suitability to implement these EPAs. Based on median ratings and content validity index (CVI) analysis for indispensability in the first two rounds, all nine preliminary EPAs covered activities that were deemed essential to the clinical practice of PICU physicians. Based on median ratings and CVI analysis for clarity however, four EPAs needed revision. With an agreement percentage of 93-100% for all individual EPAs as well as the set as a whole, a high degree of consensus among experts was reached in the third round. The resulting nine PICU EPAs provide a succinct overview of the core tasks of Dutch PICU physicians. These EPAs were created as an essential first step towards developing an assessment system for PICU fellows, grounded in core professional activities. The robust methodology used, may have broad applicability for other (sub)specialty training programs aiming to develop specialty specific EPAs.

Toward competency based continuing professional development for practicing surgeons.

BACKGROUND: There has been a recent call for formal competency assessments of practicing physicians and surgeons to form a framework of competency based continuing professional development (CBCPD). METHODS: An email questionnaire was conducted regarding CBCPD. Responses were further used to inform development of semi-structured interviews. RESULTS: There were 58 questionnaire respondents (42%). There was moderate support for assessment of surgeons' technical skills (50.9%) or decision making (56.6%). Support was highest for a mechanism to flag surgeons in need of a focused competence assessment (83.0%). Eight surgeons participated in interviews. Interviews identified a range of benefits of CBCPD but also several challenges to implementation, including the need for fair, data-driven assessments, taking into account patient outcomes. CONCLUSIONS: Through listening to surgeon concerns and recommendations for implementation strategies, this study's findings may support development of an effective CBCPD strategy with the potential to be embraced by surgeons and foster an environment of improved safety and performance.

Creating a Competency-Based Medical Education Curriculum for Canadian Diagnostic Radiology Residency (Queen's Fundamental Innovations in Residency Education)-Part 1: Transition to Discipline and Foundation of Discipline Stages.

PURPOSE: The Royal College of Physicians and Surgeons of Canada (RCPSC) has mandated the transition of postgraduate medical training in Canada to a competency-based medical education (CBME) model divided into 4 stages of training. As part of the Queen's University Fundamental Innovations in Residency Education proposal, Queen's University in Canada is the first institution to transition all of its residency programs simultaneously to this model, including Diagnostic Radiology. The objective of this report is to describe the Queen's Diagnostic Radiology Residency Program's implementation of a CBME curriculum. METHODS: At Queen's University, the novel curriculum was developed using the RCPSC's competency continuum and the CanMEDS framework to create radiology-specific entrustable professional activities (EPAs) and milestones. In addition, new committees and assessment strategies were established. As of July 2015, 3 cohorts of residents (n = 9) have been enrolled in this new curriculum. RESULTS: EPAs, milestones, and methods of evaluation for the Transition to Discipline and Foundations of Discipline stages, as well as the opportunities and challenges associated with the implementation of a competency-based curriculum in a Diagnostic Radiology Residency Program, are described. Challenges include the increased frequency of resident assessments, establishing stage-specific learner expectations, and the creation of volumetric guidelines for case reporting and procedures. CONCLUSIONS: Development of a novel CBME curriculum requires significant resources and dedicated administrative time within an academic Radiology department. This article highlights challenges and provides guidance for this process.

Integration of Chronic Disability Management in a Medical Student Curriculum.

ABSTRACT: Increasing exposure to the needs of patients with chronic disability is important in fostering confidence and comfort in disability knowledge and management among medical students and residents of all disciplines. The 2013 Association of American Medical Colleges Graduation Survey of graduating medical students revealed that 33% expressed inadequate exposure to disability management and rehabilitative care. To address this, a 3- to 4-wk rehabilitation elective course was modified to include lectures, media-based reflections, and a hands-on wheelchair experience. Responses and reflections from students from November 2015 to February 2019 were analyzed to assess the impact of the intervention on medical student knowledge and clinical practice using a disability pretest and posttest design. Preintervention data revealed limited knowledge of terminology in disability health that improved greatly in the postelective assessment. Medical students also gained knowledge on disability laws, available resources, and improved identification of appropriate accommodations to limit barriers to care. Moreover, this novel, interdisciplinary rehabilitation elective experience increased medical student knowledge and exposure of disability management. Incorporating these changes into the medical school curriculum will be invaluable in training future physicians to close the gap in access to care for persons with disabilities.

Teaching Medical Epistemology within an Evidence-Based Medicine Curriculum.

Issue: Epistemology, the branch of philosophy that deals with the nature, value, and use of knowledge, receives little or no formal attention in medical education. Yet the understanding of medical epistemology - focused on what kinds of medical knowledge are relevant to clinical decisions, the strengths and limitations of those different kinds of knowledge, and how they relate to one another and to clinical expertise - represents a critical aspect of medical practice. Evidence: Understanding the meaning of the term "evidence" is one of the fundamental tasks of medical epistemology. Other foundations of the evidence-based medicine movement, such as the "hierarchy of evidence" and the concept of "best" evidence, rest upon epistemological assertions, claims regarding the appropriate kinds and relative value of knowledge in medicine. Here we rely upon the work of philosophers of medicine who have been engaged in debates regarding the epistemic tenets of the evidence-based medicine movement. We argue that medical students and physicians-in-training should learn basic terminology and methods of epistemology as they are being introduced to the concepts and techniques of evidence-based medicine. Implications: The skepticism and critical analysis encouraged by EBM can and should be applied to the underlying assumptions and primary tenets of EBM itself. It is not enough for philosophers to partake in this endeavor; students, trainees, and clinicians need to carefully and constantly examine the reasons and reasoning that coalesce into clinical acumen. Our role as medical educators is to give them the tools, including a basic understanding of epistemology, to do that over a lifetime.

Development and Implementation of International Curricula for Joint Replacement and Preservation.

The number of patients undergoing joint replacement and preservation procedures continues to increase worldwide. Globally, there is no standardized educational pathway, training program, or recognized certification program for surgeons in these procedures. Development and implementation of new competency-based curricula to deliver specific educational events and resources may help trainees and practicing surgeons be able to perform these procedures more effectively and therefore improve patient outcomes in their respective countries. Ideally, a curriculum would be globally standardized and professionally designed to interactively meet the needs of surgeons. A competency-based approach with built-in assessment and evaluation processes is today's educational standard.

Identifying Entrustable Professional Activities for Shared Decision Making in Postgraduate Medical Education: A National Delphi Study.

PURPOSE: Although shared decision making (SDM) is considered the preferred approach in medical decision making, it is currently not routinely used in clinical practice. To bridge the transfer gap between SDM training and application, the authors aimed to reach consensus on entrustable professional activities (EPAs) for SDM and associated behavioral indicators as a framework to support self-directed learning during postgraduate medical education. METHOD: Using existing literature on SDM frameworks and competencies; input from an interview study with 17 Dutch experts in SDM, doctor-patient communication, and medical education; and a national SDM expert meeting as a starting point, in 2017, the authors conducted a modified online Delphi study with a multidisciplinary Dutch panel of 32 experts in SDM and medical education. RESULTS: After 3 Delphi rounds, consensus was reached on 4 EPAs-(1) the resident discusses the desirability of SDM with the patient, (2) the resident discusses the options for management with the patient, (3) the resident explores the patient's preferences and deliberations, and (4) the resident takes a well-argued decision together with the patient. Consensus was also reached on 18 associated behavioral indicators. Of the 32 experts, 30 (94%) agreed on this list of SDM EPAs and behavioral indicators. CONCLUSIONS: The authors succeeded in developing EPAs and associated behavioral indicators for SDM for postgraduate medical education to improve the quality of SDM training and the application of SDM in clinical practice. These EPAs are characterized as process EPAs for SDM in contrast with content EPAs related to diverse medical complaints. A next step is the implementation of the SDM EPAs in existing competency-based workplace curricula.

The power of subjectivity in competency-based assessment.

With the introduction of competency-based undergraduate curriculum in India, a paradigm shift in the assessment methods and tools will be the need of the hour. Competencies are complex combinations of various attributes, many of which being not assessable by objective methods. Assessment of affective and communication domains has always been neglected for want of objective methods. Areas like professionalism, ethics, altruism, and communication-so vital for being an Indian Medical Graduate, can be assessed longitudinally applying subjective means only. Though subjectivity has often been questioned as being biased, it has been proven time and again that a subjective assessment in expert hands gives comparable results as that of any objective assessment. By insisting on objectivity, we may compromise the validity of the assessment and deprive the students of enriched subjective feedback and judgement also. This review highlights the importance of subjective assessment in competency-based assessment and ways and means of improving the rigor of subjective assessment, with particular emphasis on the development and use of rubrics.

A practice improvement package at scale to improve management of birth asphyxia in Rwanda: a before-after mixed methods evaluation.

BACKGROUND: Helping Babies Breathe (HBB) is a competency-based educational method for an evidence-based protocol to manage birth asphyxia in low resource settings. HBB has been shown to improve health worker skills and neonatal outcomes, but studies have documented problems with skills retention and little evidence of effectiveness at large scale in routine practice. This study examined the effect of complementing provider training with clinical mentorship and quality improvement as outlined in the second edition HBB materials. This "system-oriented" approach was implemented in all public health facilities (n = 172) in ten districts in Rwanda from 2015 to 2018. METHODS: A before-after mixed methods study assessed changes in provider skills and neonatal outcomes related to birth asphyxia. Mentee knowledge and skills were assessed with HBB objective structured clinical exam (OSCE) B pre and post training and during mentorship visits up to 1 year afterward. The study team extracted health outcome data across the entirety of intervention districts and conducted interviews to gather perspectives of providers and managers on the approach. RESULTS: Nearly 40 % (n = 772) of health workers in maternity units directly received mentorship. Of the mentees who received two or more visits (n = 456), 60 % demonstrated competence (received > 80% score on OSCE B) on the first mentorship visit, and 100% by the sixth. In a subset of 220 health workers followed for an average of 5 months after demonstrating competence, 98% maintained or improved their score. Three of the tracked neonatal health outcomes improved across the ten districts and the fourth just missed statistical significance: neonatal admissions due to asphyxia (37% reduction); fresh stillbirths (27% reduction); neonatal deaths due to asphyxia (13% reduction); and death within 30 min of birth (19% reduction, p = 0.06). Health workers expressed satisfaction with the clinical mentorship approach, noting improvements in confidence, patient flow within the maternity, and data use for decision-making. CONCLUSIONS: Framing management of birth asphyxia within a larger quality improvement approach appears to contribute to success at scale. Clinical mentorship emerged as a critical element. The specific effect of individual components of the approach on provider skills and health outcomes requires further investigation.

Evaluación tradicional: ¿refleja el logro de competencias en investigación? / Traditional evaluation: Does it reflect the achievement of research skills?

No disponible

Learning and Development of Diagnostic Reasoning in Occupational Therapy Undergraduate Students.

BACKGROUND/AIM: One way to facilitate occupational therapy undergraduate students transferring their academic skills of data gathering and analysis to professional settings is to ensure they can competently use diagnostic reasoning. Nevertheless, there are several obvious gaps in empirical evidence related to the learning and development of this style of reasoning in occupational therapy undergraduates. The most important are related to promoting higher-order thinking and the use of information to solve problems in the context of professional practice. This study analyses undergraduates' diagnostic reasoning and its changes during their education. MATERIALS AND METHODS: This multicentre study was conducted with a descriptive observational design. The study took place at the University of Coruña (Spain), University of Castilla-La Mancha (Spain), and University of el Valle (Colombia). The sample was n = 247. For data collection, a clinical case was specifically designed. IBM SPSS Statistics (v19) and EPIDAT 3.1 were used for the data analysis. RESULTS: Participants identified and categorized occupational performance problems. However, they had difficulties when identifying and categorizing the occupational performance components (specifically, the symptoms and signs of the disease presented in the study case). They presented limitations to analyse and synthesize the information collected to develop an explanation of the occupational problems and their causes. CONCLUSIONS: Undergraduate students' ability to analyse and synthesize information during data collection is poorly organized, so it makes the problem formulation difficult. This study contributes to the knowledge of undergraduates' diagnostic reasoning features, specifically the undergraduate students' capacities and limits to process information during the occupational assessment.

[Smoking cessation support workshops in medical training programs in Lebanon]. / Apprentissage de l'aide au sevrage tabagique dans les formations médicales au Liban.

INTRODUCTION: Tobacco use is a major public health problem in our societies today. Nevertheless, effective smoking cessation interventions can reduce tobacco-related morbidity and mortality. AIM: The aim of this study was to develop, implement, and evaluate a Competency-Based Approach (CBA) training program for residents in Lebanon aiming to improve their skills in counseling patients about smoking cessation. METHODS: We followed a systematic educational planning starting by identification of professional tasks and competencies to acquire. A cross-sectional descriptive study was conducted for 16 residents to analyze learning needs and determine learning objectives. The workshop was chosen as a learning method. A pre-post intervention analysis made it possible to evaluate the progress. RESULTS: Pre-intervention analysis showed that residents lacked skills and faced barriers in smoking cessation interventions (score of the items “General Knowledge”: 7.1/10; “Practices”: 6.5/10; “Skills”: 3.8/10; “Barriers”: 5.6/10). There were statistically significant improvements in all scores as well as significant decrease in barriers post-intervention (score of the items “General Knowledge”: 9.4/10; “Practices”: 9.2/10; “Skills”: 8.3/10; “Obstacles”: 2.1/10). The evaluation of the workshop was overwhelmingly positive. CONCLUSION: A CBA workshop can improve residents’ skills and effectiveness in counseling patients about smoking cessation. It should be integrated into the medical curriculum and delivered to every physician especially in a country with one of the highest rate of smoking and the weakest tobacco control strategies.

Gett'n on the bus: evaluation of Sentinel City®3.0 virtual simulation in community/population health clinical placement.

Objectives The purpose of this project was to implement and evaluate the integration of a computer-based virtual simulation program into a community clinical course as an alternative or complement to conventional clinical with agencies or neighbourhoods. Securing quality community health clinical opportunities for undergraduate nursing students remains challenging. In addition, evidence of a theory-practice gap in community clinical education, particularly in non-traditional settings, suggests that nurse educators need to adopt different pedagogies to ensure that students will gain competencies necessary to practice community/population health nursing. In response, we piloted the use of Sentinel City®3.0, a virtual reality simulation program. Method A 5-point Likert-style questionnaire was administered to students randomly assigned to different clinical placements. Results Results indicated that there were no learning outcomes in which students in Sentinel City®3.0 reported percentages lower than students in agencies or geographical neighbourhoods. When there were statistically significant differences, students engaged in Sentinel City®3.0 performed better than students in other experiences. Conclusion We recommend further exploration of multi-contextual pedagogies for community clinical.

Clima de aprendizaje y preparación para el aprendizaje autodirigido en cirugía: ¿influye el enfoque de enseñanza? / Learning climate and readiness for self-directed learning in surgery: Does it influence the teaching approach?

INTRODUCCIÓN: Existe controversia sobre el efecto clima de aprendizaje sobre el aprendizaje estudiantil autodirigido. Este estudio pretende comparar este efecto entre 2 enfoques de enseñanza en cirugía. MÉTODOS: Mediante cuestionarios previamente validados, se evaluaron las percepciones estudiantiles sobre el clima y las capacidades de aprendizaje autodirigido en un enfoque de enseñanza interactivo (aula invertida) y uno tradicional (clases magistrales). Se calcularon las correlaciones intervariables en cada grupo y luego se realizaron comparaciones entre los 2 grupos. RESULTADOS: Un total de 75 estudiantes (aula invertida) y de 74 estudiantes (clases magistrales), autodiligenciaron los cuestionarios al final de cada curso de cirugía. El clima de aprendizaje fue superior en el aula invertida, sin embargo, las percepciones de aprendizaje autodirigido fueron similares en ambos grupos. Todas las correlaciones entre los puntajes de los 2cuestionarios, globalmente y por dominio, fueron superiores en el aula invertida, respecto a la clase magistral (p < 0,05). CONCLUSIONES: El aula invertida fomenta un clima de aprendizaje superior, con respecto a la clase magistral, que se relaciona positivamente con el aprendizaje autodirigido en estudiantes de cirugía. No obstante, las capacidades de aprendizaje autodirigido son similares en ambos enfoques y ofrecen oportunidades de evaluar otros factores en el contexto

INTRODUCTION: The effect of learning climate effect on self-directed student learning remains controversial. This study aims to compare this effect between 2teaching approaches in surgery. METHODS: Using previously validated questionnaires, student perceptions about climate and self-directed learning were evaluated in an interactive teaching approach (inverted classroom) and a traditional approach (lecture). The inter-variable correlations in each group were calculated and then between both groups. RESULTS: A total of 75 students (inverted classroom) and 74 students (lecture) self-completed questionnaires at the end of surgery course. Although the learning climate was higher in the inverted classroom, the perceptions of self-directed learning were similar in both groups. All correlations, between the scores of the 2 questionnaires, overall, and by domain, were higher in the inverted classroom, compared with lectures (P < .05). CONCLUSIONS: The inverted classroom fosters a higher learning climate, with respect to the lecture, which is positively related to self-directed learning in surgical undergraduates. However, self-directed learning skills were similar in both approaches, and offer opportunities to evaluate other factors in this context